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Oi;  GTJLDTKIJT  MTTir  DG  FX^l,  APm)AClIIIIG 
COIlJTRAiriTD  KAIIMA^ 

by 

Konrieth  J.  Arrov 
Leonid  H\irvic2 


1.  A  Grttdliati  itoUtod  Iqi  UaaQMtaUiKri  IkalflB* 

Let  X  ^  real-valued  function  of  the  n-dinenalonal  variable 
X  =  (x^|..,,x^).  The  n-dlzaonalonal  Euclidean  space  of  the  j'e  will  be 
denoted  by  X  •  Suppose  x  mnxlnizeg*'  X  over  the  space  l.o,, 

(1)  f(i)  ^  t(x)  for  tOl  j  In  1. 

Suppose  X  is  analytlo  and  strlotly  oonoave.^  Then  It  Is  inovn^  tbot  the 


•yatem  of  differential  oqmtlons, 

(2)  dx^/dt  =  )  f/  )  i  =  l|*.«9ny 
hae  a  set  of  eolutlona) 

(3)  X^  =  |t|  A(0)]j  1  =  ly»««yD| 

converging  to  the  meudoun*  I*e.| 

(4)  11®  ^4  1(^)1  ~  1  ~  l>*»»jn» 

Beoauae  the  vector  f ^  =  { )  f/Jx^y,,,y  Jt/ )x^)  Is  known  aa  the 
of  the  function  X»  the  procesa  defined  (2)  Is  called  the 
gradiAnt  rtrecoee.^ 

1.  Thia  la  a  noro  technical  caqxjsltlon  of  Uie  ideas  akctoliod  In  ^]. 

2.  IUnlaisatlon  of  g  Is  oq\d valent  to  naxlialsatlon  of  -  g# 

3.  Tha  fxznotlon  X  1*  to  be  (stj^^tlyl  ooncaye  If  for  any  ^  it 

and  ai;y  0|  C  <  6  <  1»  f  (l  ~  ©)  (>)  ^  )  +  (1-^)  f(x  ). 

4«  See  [pji  pp.  Xl-2, 

5*  When  the  gradient  method  la  applied  to  a  Inlalzntlon  probleiay  It 
la  aoaetlmes  oollod  the  method  of  atoeoeat  deaoant. 


ltd  In  the  pnaont  oontcatt  la  dtie  to  tha  faot  thnt  it  oan  be  uaod 

aa  a  computational  tochnique  for  aolvin^  eactreolnation  poDbleoa*  Thia  is 
done  by  oonatruotioG  flnita  differonoo  approadmations  to  (2)  and  oarxying 
on  the  prooaae  until  the  x^'a  appear  to  be  undergoing  little  ohonge* 

2.  QU^ar  fkUait  Qf 

It  la  natural  to  oonsider  two  types  of  eoctoosions  of  the  gradient 
prooeaa*  On  the  one  hand|  one  might  wish  to  apply  it  to  a  "atatlonary" 
point  other  than  on  cxtreounif  vlz«f  to  the  aaddl^noint  of  a  funetlnn,  Cn 
the  other  hand|  one  may  use  it  in  oonneotion  with  yt-nie  aubieot  to 

In  the  light  of  the  Kafan-Tucker  theoren  oited  in  aeotlon  4 
belo^')  the  tM)  oxtonaions  are  aloaely  related. 

3.  A  Gradimt  Iktbod  for 

Lot  i-l  and  be  Euclidean  spaces  of  dlaons  to  nail  ties  jj  and 
rospootlTelj'i  and  let  UC/^|  VC\/^b€  some  given  fixed  subsets.^  A  real- 
valued  function  r  (U|  v)y  U  e  U|  V  e  V,  is  sold  to  have  a  wnddlrv-nnint. 
aver  V  at  (u,  v)  11  ^  ^  v  t  V, 
andy 

(Uy  v)  ^  Y  (Uy  v)  ^  V  (u,  v) 

for  all  u  e  Uy  v  £  V,  (Any  unconatrainod  laaxial nation  (reap,  minialaatlon ) 
problea  nay  be  vievod  aa  a  special  cose  cf  such  a  soddl^polnt  with  q  =  0 
and  U  =  7/  (rosp.  p  -  0  and  V  =  )•) 

Olnce  the  saddle-point  (u,  v)  lo  a  anxlmc  in  and  a  alnintta  in  ^y 
It  la  natural  to  devise  a  gradient  proooss  of  tlie  fonny 

1,  In  subae<iucnt  applicatlony  U  and  V  ore  convex  cones  with  vertices 
at  the  origin. 
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dv,/dt  =  -  J  v'/,.  Vj, 

(with  additional  rulea  for  pointa  on  the  boundorloa  of  U  and  V), 


dUj^/dt  = 


Conaidor  tha  ooao  vhor«|  for  aoiae  fLxod 


0 


OC  ii,..., 


J 


» 


^  » 


(5) 


U  =  |^(u^,.,.,Up)j  \x^  ^  0, 

V  =  V^)l  Vj  ^  0,  J  £  pj, 

daflna  tha  grodiecit  proc^a  by  the  differaintlal  oquatlonaj 
fc  if  u.  =  0,  Jy/  ju^  <  0  and  Itp'  y 
]  J’/J  ^  otharviae, 

dVj/dt  =  fo  If  Vj  =  0,  J  ,'/  J  Vj  >  0  and  j£  Q'  , 


-  )  '  // j  V , 


othenrlan, 


and  write  tha  aalutiona  of  (5)  aaj 

u.  [t^  u(0),  v(0)],  V,  [tj  u(0),  v(  )]. 

Under  whrxt  oooditlons  do  we  have  oonverganoo  in  u.  (l.e*)  11m  u.  (t)  =  xi-  ) 

1  =!,•••>  p)?  A  partial  answer  wia  civen  in  [3j.  To  state  the  result, 
note  that,  at  the  aaddlo-point  (u,  v), 

3^/  Ju^  -  C  for  oaoh  1  =  I,..*,  p 


Ju,  =  0 


for  oaoh 


and 


(6)  =  '^  Lf  )  f/  <  0  Qt  (u,  v). 


If  (6)  holds  for  1  =  1  ,  we  sliail  coil  1  a  cnmAr  inflmfji  othorviac  an 


)  u  --  (u^^^ 


(1) 


oonsintfl  of  comer 


interior  index^  We  write  u  [u'  u'  ';,Mlwrau 
Indloos,  of  interior  indiooe*  Aimloijously ,  J  is  a  oomor  indcoc  for 

if  Vj  =  0  and  ^  7hoorea  1  in  |_3j  then  stitos  the 

followtnfi 
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Let  r  (u,  v)  be  1  Inner  In  possoas  a  saddlo-polnt  at  (u,  v)  over 

U  =  u^)i  ^  0,  1  =  1, 

V  =  |(v^,...,  v^)j  -  0,  J  =  1, 


•••iP 


find  be  analytic  In  aono  nolgliborhood  of  (u,  v),  Suppose  finrther  that,' 


(a)  II  ^  ^  II  la  negative  deflnlU  at  (u,  t), 

(b)  >  f  ,  Vj  >  ">  for  every  Interior  Index  J,  or  J.. 

Then  for  crver}'  initial  position  (u°,  v®)  In  a  auffioicntly  snail  neighbor¬ 
hood  of  (u,  t),  there  is  a  unique  lolutlon  u°,  v°),  Vj(tj  u® ,  v°)  of 

the  gradient  equations  inioh  that, 

UJI  U-(t|  U°,  V^)  -  VL,  1  =  !}•••>  p* 

t_^  -  1  1 

This  result  was  extended  by  H.  Ui^avu  In  1955  in  on  unpsihlishod  note) 
he  shoved  that  the  assertion  of  tlie  preceding  thoorm  Is  also  valid  In  the 

Large  (and  not  onij'  for  (u°,  v®)  close  to  (u,  v))  when  /  Is  oasuDed 

4 

strlctl;,'  cononve  In  for  oaoh  x* 


fflT  Gflnfltimlnfnl  [■'ytirm* 


It  Is  natural  to  Inquire  (as  SaamaLson  has  done  In  the  linear  oase^ 
see  [4j>  pp»  17-22,  74-78)  vhethor  or  not  oomc  larlont  of  the  gradient 
process  could  bo  used  In  probleas  where  mnylmt ration  may  be  subleot  to 
Qonfl train tfl.  '7o  slvill  consider  the  case  vr*-.ore 


1.  Thoorea  2  of  treats  the  case  of  i  (u,  convex  In 

2.  Ibctenslon  to  the  case  where  U  and  V  ore  more  general  Is  Inmedlato. 

3.  That  Is,  ,  is  locally  strictly  concave  In  u 

4«  Condition  (b)  of  the  above  theorem  Is  not  nnedod  for  Unawa’s 
results. 
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^1)  la  reploood  bj', 

(7)  f(i)  t  f(x)  for  oil  i  In  1  siioh  tliat, 

(7*1)  »  J  I- ^1, 

(7*2)  —  C|  1'  L  I  2j 

where  aivV’or nny  bo  enpty,  so  that  the  oase  of  an  unconstrained 
onjclgim  la  covered*  The  caao  of  equality  oonstrolnta  la  qIdo  Ineluded, 
alnoe 

h(x)  =  0, 

la  equivalent  to  the  pair  of  Inofiuall  tlcs.^ 
h(x)  -  0,  -  h(x)  -  C* 

la  view  of  the  applicability  of  ^jmdient  prooeaaoa  to  saddlc^polntsj 
a  method  of  deriving  a  (jrodlcnt  p'ocoss  for  a  conatmlned  ninxlnun  lo 
•\iCgestod  the  Kuim-Tuokor  [^5]  reaulta  viilch  oatahllshoa  the  wiulvolence 
of  the  two  kinds  of  probloma  when  X  anu  all  the  Cj'^  oonoave  and 
subject  to  a  regularity  condition  (the  "Constraint  Qualification")  on 
the  Kj'o  uhloh  wo  shall  tacitly  aesuao  In  vhnt  follows*  The  Kahn-Tucher 
theorem  states  thnt|  provided  the  functions  X  Ej  concave,^  the 


Lagroaglan  eacpresslon) 

^(u,  v)  =  f(x)  +  y'g(x), 
has  a  soddlo-polnt  x  at  (x,  y)  over, 

X  =  [(x^,**.,  X^)l  x^'  ^  0,  1»  £  'j, 

Y  -  |(y,,..*,  y  )i  y.  ^  J  t 


J 


vdth  X  =  X,  whore  x  mroclni^ios  f(x)  subject  to  (7*1)  anti  (7.2). 

In  turn,  one  may  apply  tho  gradient  process  to  the  Ingi'onglan  exproe- 
slon  ^(x,  y)  and,  In  the  light  of  the  preceding  section,  oonvergenoo  In  the 


1«  ttet  wtoMt  ui  wcpmllty  owtralnt  h(x)  •*  0  U  rwiprmmtUd  l^r 
o  Inoqmlitleo^^hjx)  h  0  aj^  -  h(x)  &  Of  the  oenoxvlty  reqplrmmai  tbr 


two 

both  hCx)  oad 


that  J} 


be  1 Ineer. 
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x-ooapononts  will  occur  provided  thnt  ^(xj  >')  la  atriotlv  ooncave  lii  i  for 
oach  y)  la  tx)  be  atrlctly  »noQve  in  ^  for  each  It  la 

not  aufflolent  tlat  X  ^J**  ^  aeraly  tyancnve  In  ^  Cn  the  other 

hand,  it  ^  aufflolent  if  X  1®  atrlctly  oonoave  while  the  Ej*®  oonoave* 


5.  Thf  Mnear  Caaei  Loral  C^rrvmryc^r^^^t> 

3o  for,  we  ore  in  a  position  to  treat  by  gradient  proooasea  (via 
oonveralon  to  aaddlo-polnta)  any  constrained  rrodmlsatlon  prohlea  \dieare 
the  constraint  functions  ore  all  oonoave  and  the  naxlaond  X  atrlotly 
ooncave.  In  partlo\ilar,  the  g  's  might  be  ilnoar.  Hovovor,  the  roqulro- 


nent  that  X  I*  atriotlv  oonoave  asocliklea  the  poaaiblllty  of  a  linear 
moxlnond*^  lienee,  one  is  led  to  look  for  a  dovioe  that  would  anko  it 
poaalhlo  to  handle  a  problen  that  Is  oomplotaly  linear,  or,  more  generally, 
where  X  euxi  the  Cj*®  cire  concave  but  not  necessarily  strictly  oonoave* 

A  devloe  of  thla  typo  wua  eoepLorod  In  [b],  whore  the  Lngranglnn  e»» 
prosjlon,  ^  =  f  t  j'g,  was  replaced  try  a  nodiflnd  lyurmngian  wmrnaalon 

hj  =  hj(x)  =  1  -  gj(x)i 

n  ^  ' 

rij  -  .  . 

It  was  aliown  In  [c]  that  subject  to  certain  regularity  conditions  cai. 
bo  made  lananv  striotiv  ooncave  in  the  interior  oonpononts  of  by 
selecting  sxxfflclontly  large  values  of  the  Hj’®*  (This  statement.  In 
fact,  holds  for  anv  sufficleiitly  regular  C  L’j«)  I*'  oomblnatlon  with 

the  ptrexjeding  results.  It  follovD  that  the  gradient  prooosa  applied  to 


1.  Gonuolson,  as  noted  above,  applied  the  grodiont  pa*oooe8  to  the 
purely  linear  casej  ho  obtained  constant  amplitude  oscillations  rather 
tlwn  convergence* 
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the  Qodlfied  LAgr&ngiAn  eaq3refaion  oonvargvs  to  the  oonstralnad  lUcVinw 
if  the  initial  position  ia  auffioiflctly  oloae. 

6«  The  Linear  Caaex  Gli»ba1 

In  19?5-6|  the  pax>bIcD  of  oouTorgenoe  in  the  linear  oa««  uae  reooi>- 
■idered  under  the  utiiauletian  of  the  ooQputational  applieatimie  of  the 
iQodified  lagrengian  gradient  loethod  oarried  on  at  RAI^  l:(/  T*  MaroohaJe 
in  oonneotion  with  linear  programing  problma*^  The  prohlm  of  ohief 

intereat  uaa  vheUiar  or  not  oonvergenoe  in  the  large  ootild  be  ooqjeoted* 

2 

Thia  W5rk  led  to  reaulta  aboving  that  if  the  nodlfiod  Lagmngian  gradient 
aethod  ia  applied  to  a  linear  prograniaing  problen,  oonvergenoe  in  the 
large  of  the  x-oooponanta  ia  guaranteed)  although  it  may  be  neoeaaary  to 
uae  a  variant  (to  be  dcacribed  belov)  of  the  mod if  led  Ingranglan  etxpreaaion* 
To  state  those  roaiUta)  vc  ntuet  first  intixxluoe  a  oonoept  vhioh  fits 
between  oonoovlty  auid  atriot  oonoavlty)  to  be  oallod  partial  atriot 

naflnit.iian^  h(x)  is  an  Id  to  be  part5>U  ly  strictly  oonoave  if)  for 
any  siich  that  h(x^)  ^  C,  h(3(^ )  =  i  )  the  function  H(d)  =  h[(i-^)  x^ 

+  &  X^J  )  0  -  d  -  1,  la  a  oonoave  but  not  linear  function  of  ©. 

To  eimplif^  Uie  exposition,  consider  the  case  wlxere  a  unique  mxi- 
aizing  point  x  la  known  to  eodat*  Then  it  has  been  shown  that) 

Theorem  A«  r^aoh  x^  w'JLL  converge  to  under  tlie  gradient  proooas 
applied  to  the  umaodifled  lagrongion  axpreasion  ^  provided  ia  oonoave, 

1,  Gee  Appendix* 

2.  Carried  out  by  the  autliora  under  the  auspices  of  the  Office  of 
Naval  Research  and  the  Center  for  Advanced  Gtudy  in  the  Behavioral 
Geienoes)  roapeotlvely* 


2-.JLr57 

— 


each  gj  !■  partieuUy  ftrlotljr  oonaare  in  Xi  funotiona  are  axiaJortle 

But  this  thsoreca)  by  Itself}  Is  ixiadequate  to  daal  vlth  the  oase 
where  X  Ej'*  linear.  Thus  ve  Bust  fall  back  on  a  aodl- 

fled  lagranglAn  eaqpresslon. 


DaflMtlan.  The  fXBlOtlon, 

4^0  (x,  y)  =  f(x)  +  J  Xj  ^  [Ej(^)]  » 

is  oalled  the  -Bodif iad  lagraaflAn  expression  for  tho  laartalaatioo 
of  X  s^Joot  to  gj(x)  -  0,  J  it  the  functions  are  strictly  1»* 
creasing  and  F^(0)  -  0. 


Wa  than  bavs} 

A 

Th4w>T»<«n  B.  Each  x^  vlU  oonverge  to  x^  under  tho  gradient  process 
appU«i  t.  th.  Ug«^  -cpr—lon  provided  X  and  «r. 

ooQoave  and  analytic  and  each  is  strictly  oonooTc. 

In  this  oase  the  constraints  f]  [ejU)]  ^  0  aro  equivalent  to  the 
oonstxaints  Sj(x)  ~  0  but  tho  former  satisfy  the  oonditlons  of  Theoren  A. 

Thcorota  B  is  applicable  to  ooDpletely  linear  ponobleaS}  einoo  X  °J3d 
gj  are  only  required  to  be  concave. 

The  oodifiod  lagranglan  expression  in  section  5  above  corresponds  to 
oliooBing} 


J 


'J, 


Hj  >  0, 


which  satisfios  tho  requirements  of  Theoretn  D  for  v  <  1.  It  cannot  be 
fMWtotd  to  insure  oonvorgenoe  in  a  linear  programing  probleo  unlees 
gj  (x)  <  1  th2X)Ughout  the  gradient  process.  On  tho  other  hand} 

(v)  =  1  -  e  ■  "Ij  "  ,  >  0, 
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haa  tho  required  proper^.iea  for  all  ^  and  oon  aafely  be  uaod  in  tlio  largo » 
l.o*,  for  any  Initial  vnltiaa,  tho  grcuJlont  pirooeas  applied  to  the  -nodl- 
flod  Ingranglan  oKpreaalon  for  a  linear  (or  any  concave)  prograaalng 
problem  vlll  oonverge. 


In  T.  MDLrechak*a  experimental  coaputa  tlena ,  tho  oodifled  lAgranglan 
axpreaalon  waa  fcrmed  uaitig  P  but  a  cheok'^luan  waa  carried  to 


zoake  auro  that  £j(x)  reoained  leaa  than  1  dis’ing  the  proceas. 

A  check  of  tha  expei*lBental  ocajputationa  wua  alao  offered  br,'  verlly- 
ing  tliat  the  "diatanoe  function," 

D  =  •£  (x^  -1^)2  +  ^(Vj  -  yj)', 

alwaya  docreaaed  with  tine*  (The  tbeoreaB  on  convergonce  are  baaod  or. 
the  foot  that  dD  /dt  <  C  in  a  gradient  prooeaa. )  Thia  chock  la  onl;,'  of 


intereat  in  the  e:]q)erlaental  computatiena ,  alnce  it  requlrea  knovlodpo 
of  tho  uxiknoun  of  the  problem)  xLi«f  ^  oomputatlona  thenar  Ivea, 

maa  the  Appendix. 
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\jy 

T.  Marachcik 


This  appoiylix  reporta  on  ooao  ooaaputatlona  Iji  which  th^  gradient 
method  wna  applied  to  the  ^-modified  Lagrangian  axpreaelon  of  aootlon 
6  -  with  the  funotiona  taking  the  form  for  two  linear  prograra- 


aing  prohl 


In  the  ooDputationa  the  r)^  were  taken  to  be  the  aaioe  for 


all  j|  l«e«)  T] j  —  f]j  j  —  l|**«^m« 

The  aine  of  the  oonpirtatlone  were  (l)  to  explore  tl^e  major  diffioultiea 
enoovtntex^  in  pax>grBaalng  the  greuiient  method  (aa  applied  to  oonatrained 
naxlmizationa  pax)hleoa)  for  a  digital  computer}^  (2)  to  obtain  aono  pro- 
llninary  evidence  aa  to  the  offioiency  of  the  method  in  aolving  linear 
prograaming  prohleiaa  of  different  alzea  as  wall  aa  the  effect  of  varying 
r)  and  varying  the  Exiolldean  diatonce  of  the  initial  point  from  the 
equilibrium  point. 


(1)  areguMlng 


Two  major  paogroiiiaing  prohlena  were  anoounteredi  (a)  the  modification 
of  a  atable  method  for  apptroxlaftting  differential  e<iuatlon  ayetona  ao  aa 
to  allow  for  "oomor"  oondltlona^  (b)  aatlafaotlon  of  the  oonstraint  on 
the  range  of  numbera  which  may  ooour. 


(a) 


a  atable 


tlflftUnr  Bfitoi* 


If  a  digital  computer  la  to  be  uaod  In  obtaining  Uie  patiia  of 
variableBi  aa  determined  b>'  a  ayatem  of  differential  oquatlona  and 


1.  The  RAM)  Johnninc  waa  the  mc'ilnr  usoJj  t-hc  coding  a:id  mchine 
work  wore  done  bj-  >to.rvln  Shapiro, 
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ari  Initlfli  {joint,  tho  Lyatoni  nuat  flrot  bo  approxlnatod  n  syoton 
of  difforonco  oqwtloruj.  The  almploat  approxloatlon  to  a  syateo 
cl  1  =  la,  of  oourae,  the  difference- 

equation  lyatoQ 

(t)  -  (t  -  1)  +  h  [2^  (t  -  1),....,  0^  (t  -1)] 

"  2^  (t  -  1)  +  h  (t  -  1)  (h  >  o) 

Tliia  ayaton  definea  for  oacli  variable  a  serlea  of  oonneoted  itrai^ht- 
line  set^aents  approxiraatin^;  Uie  true  path  of  the  variable  (aa  defined  by 
the  differontlal-etiuation  ayatom),  ’Jnloaa  ]j  la  taken  sufficiently  anal  1 , 
however,  Uiere  la  a  dan^-er  that  when  the  true  path  of  a  variable  0^  under¬ 
goes  a  siiarp  cliange  in  slope  between  t  and  t  +  1,  the  approximating  peth 
between  t  +  1  and  t  2  (being  based  on  the  slope  of  the  approximating 
path  at  t)  will  Ijc  on  eoctrapolation  of  the  true  patli  os  it  woa  prior  to 
th<,‘  ahirp  change  in  slope.  The  approximating  path  may  then  deviate 
further  j-nd  furtiier  from  tlie  true  one.  To  eocclude  tdiis  danger  may  require 
to  bo  no  small  that  convergence  is  usoleasly  alow. 

Chiefly  for  this  reasonj  cioro  stable  approximation  methods  have  been 
devised.  One  of  tlio  moat  widedy  used  la  the  Kunge-Kutta  method  (  [a  j  , 
pp.  301-C)  wlilch  waa  useci  in  the  experimental  computations.  In  thla  method 
the  Iteration  loading  from  2^  (t-l)  to  3^^  (t)  oonoiats  of  the  following 
stops  J 

(1)  3^  (t)  =  hF^  [2^  (t  -  (  t  -  1)1 

(2)  2^  (t)  =  h  \j,^  (t  -  1)  t  1/2  2^  (t),.,,,  2^  (t  -  1)  +  1/?  2^  (t  -  1 

(3)  2^  (t)  =  h  F^  [2^  (t  -  1)  +  1/!  2'^  (t),.,.,  0,^  (t  -  1)  +  1/2  2'^  (t)] 
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(4)  (t)  =  h  Cz^  (t  -  1)  +  (t),...,  Z^  (t  -  1)  +  (1)] 

(5)  8^  (t)  =  176  [»^  (t)  +  ?  zj  (t)  +  .1  8^  (t)  +  8^  (t)]  +  Z^  (t  -  1). 

5  r  T 

This  method  has  a  low  "lr*horont  error,"  of  the  order  of  li  (fee  LAj  ,  p«  302). 
Now,  In  our  case  F^,  tn  tlie  dlf ferentlal.-equatlon  syateia,  Is  of  the 


form 

r 

‘  1 


If  the  1th  argument  la  >  0 
(F*,  C)  If  the  1th  argument  la  =  0. 


No  variable,  la  allowed.  In  otiier  worda,  to  beoooD  negative. 

In  fomtulatlng  the  Kiuige-Kutta  approximation  ao  aa  to  give  effect  to 
this  oondltlon.  It  la  oloar  that  we  oannot  leave  atopa  (1)  to  (5)  aa  thety 
are.  For  If  F*  takes  a  large  (tn  absolute  value)  negative  value  for  the 
argiioents  ahovn  on  the  rlglit-hand  aide  of  on  eqmtlon  doflnlng  one  of 
the  above  Qtep>a  (l.e..  If  takoa  auch  u  value  and  If  the  1th  argument  la 
poaltlvo),  then  even  for  smAl  1  h,  (t)  laay  bo  nogatlvo.  To  solve  the 
difficulty  several  poaslbllltles  suggest  themselves j 

(l)  We  can  Impose  tiie  oondltlon  that  8^  (t)  be  tlie  maximum  of  zoro 
and  the  weighted  average  Juat  given  (in  step  (5))» 

(ll)  We  can  rewrite  steps  (l)-(4)j  everywhere  replacing  F  by  F*  and 
oan  then  Impose  the  oondltlon  Uiat  (t)  bo  the  maxlaua  of  aero  and  the 
expression  on  the  rlgiiVhand  side  of  the  equality  defining  step  (k), 
k  —  1, ... ,4* 

(ill)  When  the  value  8^^  (t)  obtalnod  at  the  end  of  the  iteration  la 
negative,  we  can  repent  the  iteration  (starting  again  with  (t  -  1)} 
for  fi  araal  1  »r  If  the  value  of  (t)  then  obtained  la  again  negative 
wo  repeat  tlie  Iteration  with  a  still  amoHor  h.  This  procesa  oontlnuea 
untLT  8^  (t)  folia  In  a  small  pre-aeloctod  interv^  (  -  t,  t),  t  >  0.  At 
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Uuit  point  2^  (t)  lo  sot  6<iual  to  rero.  For  h  ffufflolsntl^  aonil,  2^^  (t) 
muBt  fail  In  the  given  Interval. 

In  ohoosln^  between  those  aitematlvea  wo  nust  rolj'  on  Intuition 
about  tho  relative  protection  t.ie;,’  afford  sf^nlnat  major  deviation  from 
the  true  patlu  of  tiie  varlablea,  and  on  actual  experience  in  using  the 
alternatives. 

Alternative  (l)  was  attempted  and  failed  to  work  properlj':  the 

"distance  functloni"  given  in  section  6,  fluctiiated  liuitead  of  dooroaslng 

mo  no  tonic  ally,  If  alternative  (l)  1*  used  there  Is  a  danger  that  the 

follovlnc  may  occur  (and  this  may  have  oaused  the  "distance"  fluctuation)! 
k  k 

one  of  the  2^  (t),  aay  2^  (t)|  may,  because  the  value  of  on  the  right- 
hand  side  of  the  equation  defining  step  (k)  la  large  (in  absolute  value)  and 
negative,  become  large  and  negative.  Tho  dlaereponoy  between  8^^  (t)  and 
Ux©  oorrespondlng  true  value  of  2^^  Is  then  unusually  large  (as  oompered 
to  the  dlsorcpanoy  In  nji  interval  vdiore  naithor  true  nor  appaxndaatlng 
values  are  near  zero),  Thon  averaging  the  (t)  (in  step  (5))  and 
taking  the  maxlnium  of  the  result  and  zero  may  well  not  erase  t2ie  large 
dlsoreponoy,  e«g.,  the  true  valixe  oorrospondlng  to  a  zero  (t)  may  be 
large  (and  positive). 

Alternative  (il)  on  the  other  hand  is  oertalnly  risky,  since  the 

true  functions  ore  not  used  In  the  appai^xinatlon.  Thus  unless  h  is 

aiaad.l  enoixgh,  there  Is  a  danger  that,  after  tal.^ng  a  positive  value, 

# 

in  tho  true  path  descends  sharply  (with  a  largo  negative  slope  F^^)  towards 
zero,  but  without  reaching  zero]  vhllo  in  the  approximating  path  0^^  is 
suddenly  given  tho  value  zero. 

Alternative  (111)  appears  to  be  the  best  of  tho  three,  aocordlng  ae 
it  does  with  the  general  Intuitive  notion  that  the  approximating  "grid" 
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nootle  to  Ixi  "finer"  at  points  of  discontinuity  in  Uie  derivntivo  of  the 
true  paUi,  This  flltcmatlvc  lies  Ijoon  used  and  has  \Ajrkod  (luite  wodJ-# 
Specifically  I  in  the  routine  used,  h  is  sTjcoeealvel^'  cut  in  half  until 
(t)  falls  in  the  interval  (-  l,  c),  e  was  chosen  to  be  just  slightly- 
greater  tlwn  tho  average  rouiui-off  eri'or  eocpoctod  on  the  machine. 

(b)  Meeting  the  oonstraint  on  the  nermlsalhla  mni^e  of  values. 

L'n  the  IX’iT)  Joymnlaci  using  a  floating-point  code  (as  was  done 
in  these  computations),  only-  numbers  between  12  and  lO^*"  oon  bo 
dealt  vlth.^  !lenco  not  eiil  sets  of  values  of  h  and  r,  and  of  initial 
values  of  the  variables  can  be  used.  Thus  for  u  given  q,  tho  initial 
values  an(i  the  values  of  h  have  to  be  chosen  with  some  core,  '"hough 
a  large  q  may  lead  to  rapid  oonvergence  for  any  given  h,  tho  largest 
value  of  h  oonslotont  with  the  rcj^jr  constraint  for  sucli  an  q  may-  be 
small  enough  so  that  tlve  actual  tine  ro'^uirod  for  oonvorgance  Is 
longer  than  for  some  aaaller  q. 

2.  Hnpar  nT^in-nirml  n^;  tO  tfliich  the  gradioat  mcUiOd  uas  annl  lai. 


In  a  linear  progrosming  problor.  of  tlie  fora: 
F Ind  X  such  that  x^  =  max 


subject  to  x^  ^  ^ ^  ^1  "  I  ^ 


th*  ^-nodified  Logranglan  eaqireaalon  of  section  o  -  witii  the  fujictiona 


(1) 


P  ^  taking  the  fora  p  '  '  and  ail  q  =  q  -  is 

'  j  J 


^  [i  -  “ij  ’‘i  - 


1  +  q1 


The  gradient  process,  which  converged  to  tlie  rwiuirod  solution  (for 
an;/  initial  values  o*’  x^),  is  give::  by-  tho  diff arential-o<iuatlon  ey-sten 


1.  On  the  I.B.M.  704,  the  permissible  range  is  smaller. 
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V>it  "  -  (H  ,)  ,1^  a,  ,  y,  (  a^, 


bj  .  1)^ 


If  X. 


oaxinun  of  this  raid  zero  if  x. 


(i 


‘“ij  ^  -  ‘j  " 

LKudnua  of  thla  and  zero  If  =  '- 

(a)  \  UireQ-Ynj:lfl.hle  Uirttft-lnecniftHt.v  tirotilup 

'.  lie  fLi’st  pirohlcn  iron  ted  una  aa  foLLowii 
I-'lnd  x^,  x^j  x^  (  -  '.')  auoh  that 

Tr  =  x^  +■  dx,  +  3x^  =  oax  subjoot  to 


1  +  n 


-1  lfyj>r 


+  + 


^  1 


-  C 

s 


-  x^  + 

Tlie  aolutlon  la  ^  x^  -  l/' »  for  vlilch 

n  --  13/6  =  1.167“. 

In  the  flrat  oonputatlon  q  vms  token  to  be  2,  for  which  the  equllll>- 
itLim  voluea  of  the  y ,  are 

4/ 

y°  =  13A8  =  .?2;.>'^,  y®  =  5AS  =  .278",  y®  =  lA  =  .111*^ 

Tlio  Initial  valuoa  choaen  vei'o  1  for  x^,  5  for  x^i  3  for  x^>  3  for 
y^,  2  for  y..y  and  3  for  y^. 

In  the  aocontl  computation,  q  waa  token  ei^ual  to  7j  for  thla  oaae,  the 

oquillbrlun  voluea  of  tlie  \  .  are 

J 

-  13/48  =  .2rL^y  y°  -  5/48  =  .HA'*',  y®  =  1/24  =  .2415. 


In  the  coiaputotlon  for  tlio  caae  q  =  2  the  Initial  value  for  h  waa 
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.C  150,  In  tJie  conipuUitlon  for  the  cnfic  t;  ~  7,  uae  of  tlie  BCL’ae  h  UDuld 
hftve  boon  inposalble,  becauao  very  iAr(.;e  nunbcra  would  liavo  roflultod  In 
Ihie  oxpreflslons  Involving’  the  exponent  t]  -f  1,  yldlc  In  oilier  exproa alone 
tliere  would  nave  occured  nunbers  bo  znwb  smaller  aa  to  violate  tlio  reatrlo- 
tlon  on  ran^^e.  The  Initial  h  uaed  In  Uie  oaae  ~  7  waa  1.  The  initial 
vnlueo  of  h  uacxl  Ln  the  t;ao  caaoa  were  r  pjiroxin:i tel^'  aa  lorf^e  aa  tlxey 
cx)uld  be  wlllx3Ut  vlolalLn^:  the  m:i{;e  conatralnt^  frara  a  pa-^cllcal  point 
of  view  (l.e.  If  fast  oonvercence  la  the  nlra)  lliey  are  tiio  proper  vnluea 
to  chooao.  ’ievertiieleaa ,  they  are  auf f Iclently  different  ao  th/it  the 
ooaparlaon  of  tlie  two  caaea  vltii  roapect  tx)  the  effoct  of  vniyln^’  q  la 
difficult,  A  fioatLnc- point  oode  wna  uao'!. 

The  following:  table  partially'  autxuirlr.os  (for  aelectod  lte:vitiona) 
the  results  of  the  oomputations  for  Lhe  tliree-e  imtlon  problora,  for  the 
cases  '1  =  1  and  r)  =  7,  For  each  Iteration  in  the  table  are  ehown  (to 
tlireo  docimal  places)  the  current  value  of  the  x's,  tlie  y'sj  h  (which 
detemir.os  tlio  "slno'*  of  the  appiroxioatlng  step),  t/"  and  the  "distance" 

D  =  £  i(x.  -  x°)^  +  (y,  -  y^)'  1  ,  In  addition  to  the  variables  shown 

1=1  ^  ^ 

in  the  table,  there  wore  printed  out  (at  ever:,-  tenth  Iteration.)  the  values 
of  all  derivatives  and  tlie  values  of  tlie  left^liand  sides  of  the  tlu'uo 
ine<iualitlos.  Pi*lntint{  out  of  the  latter  \Tilue3  mode  it  posulble  to  keep 
a  running  ohock  as  to  violation  of  the  re<iuirwaent  g,  (x)  s  1  wlilch,  as 
Ini.llcate'i  In  section  u,  aust  ’.in  .-aet  if  tae  conditions  of  Thooreia  r  aro  to 
guoj-anteo  convergence.  In  none  of  the  computa' ior.3 — cit.'ior  for  Uir 
d-oiuatlon  or  tiio  5-o<iuatlon  problfo— -wa.s  this  roiulrooent  .-lot  net. 

Wo  SCO  fren  the  t-nhle  tliat  only  at  so-ne  Iteration  between  jy  nnt!  34* 
did  the  ooaputatlon  for  n  =  7  "ovojrtaxn"  tho  ooaputatlon  for  f)  =  d  -  In  tlie 


IterAtiion 

h 

*1 

X 

2 

nunbftr 

M  —  0 

0 

0.000 

1.000 

1C 

(19){10"'^) 

.291 

0.000 

20 

.0156 

.520 

.000 

73 

.0156 

.576 

.000 

15C' 

.0156 

.520 

.000 

300 

.0156 

.337 

.137 

330 

.0156 

.311 

.171 

>40 

.0156 

.31$ 

.165 

TOO 

.0156 

.333327 

.166662 

c  =2 

0 

o.ooo 

1.000 

ID 

10“® 

.092 

1.077 

20 

ic-9 

.003 

.967 

70 

.01 

.501 

.044 

153 

.01 

.496 

.'351 

X'O 

.01 

.445 

.069 

.01 

.41^ 

.oa 

343 

.01 

.405 

.091 

64. 

.01 

.33333334 

.16666663 

”l 

^2 

5.000 

l.600 

2.000 

2,123 

2.992 

2.237 

.284 

3.090 

2.4D5 

.096 

2.531 

1.723 

.241 

1.739 

.>7fr7 

.471 

.865 

.279 

083 

•806 

.274 

.486 

.791 

.275 

099990 

,722227 

.277W5 

5.000 

1.600 

2.000 

5.008 

1.6U 

2.4)10 

4.867 

1.661 

2-017 

•221 

2.025 

2.189 

.257 

1.316 

1.417 

.448 

.316 

•126 

.498 

06C 

.291 

.496 

053 

.287 

,50cx) ... 

.722223 

.277T 
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I 


D  » 

3  I 


3.000 

330?3  t 

17.000 

3.U7 

24.918  , 

6.661 

3.065 

230^58  j 

1.373 

2.342 

.864 

1.206 

4.306 

1 

1.242 

•no 

.166 

2.023 

009 

.088  1 

>  2.102 

02D 

.072  j 

2*106 

.101110 

.000042 

'  2.16662 

3.000 

33.470 

•  17.000 

3.001 

35.558 

17.272 

3.001 

34.354 

16.579 

2.866 

15.701 

.  1.251 

1 

^  .708 

2.073 

6.603 

.602 

.350 

1.927 

.317 

.092 

2.066 

.226 

•047 

i  2.000 

.11111... 

(137){K)"^  2.16666. 

I 
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Bwinc*  ol'  exhibiting’  a  unollor  Knclldoa:i  dlatance  fnon  Ukj  o<'iUiiibrlun  point. 
After  tills  Iteration  tlic  dlatance  In  tlu*  oonput-ntlon  for  r]  =  7  tiocromioa 
conaldornbly  itiorr  :’npldly  (with  roopoct  to  number  of  Iteratlonfl)  than  tho 
dliit^uice  In  tlio  ooujmtatlon  for  t]  =  d.  i’^or  example,  (this  la  not  choun  In 
tlic  table)  the  distance  l»ouaes  loos  tlian  1  ut  Iteration  30f  for  q  -  7, 
but  not  until  Itoratlnn  55t  for  q  =  d.  In  both  coinp..tatlonfi  It  In 
nocoBBOT'j  to  cut  tile  fll::c  of  h  at  aone  Iteration,  primarily,  ao  It  luippena, 
nt  early  Iterations,  '•'ach  Iteration  average.!  about  four  nooondr  for  ')  -  .. 
(allowing'  for  prlnt-ouL  tL’nc  at  oveiy  tentli  Iteration)  and;  about  five 
seconds  for  q  ~  7. 

(b)  A  nine- variable.  fiYo-ineomlity  oroblos: 

The  second  probla’.i  treated  wae  to  wtxinilze  ■  -  x,  t  x  ,  5/4  x. 

-L  d  »♦ 

+  dx^  +  -t  5/4  -  x^^  subject  to  x,  -  C,  1  -  l,,.,,v  and 

(1)  ^  1 

(2)  x^  +  -  L/’  x^^  -  C 

(d)  -  1/4  ^ 

(4)  X-,  +  X.  -  1/r  X.  -  3/8  X  “ 

d  4  a 

(5)  +  Xg  -  1/3  X  -  5/3  - 

The  solution  Is  -  b ,  x^  =  l/'. ,  x^  -  *  ^4  ~  ^  ~  \  *  ’ 

=  1/0,  x^  =  f  ,  x^  “  1,  n  =  7/43. 

In  t’lo  two  conputatlons  which  voro  j:>erforaed  q  was  taken  “  d  so  that 
at  ef^uilllTriun  y^  =  7/l44>  V-,  -  3l/7d,  y^  =  d/3,  -  5/Ld,  y^  -  d/3. 

In  the  first  coaputatlon  tlie  Iriltlal  point  cl^sen  was  that  shown 
(iteration  C)  in  the  first  part  of  the  folloutnb  bablo,  for  which  the 
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distaoM  tram  •qulUtriw  la  .327^ •  In  the  second  oomputatioc  the  Initial 
point  was  that  shoun  In  the  second  part  of  the  table  (iteration  O)  for 
vbioh  the  distance  froa  equlllbrlua  is  143*1«  The  initial  valxie  cf  h  was 
taken  to  be  *01  in  both  ooapatations*  Both  computations  are  svnmaarised} 
for  selected  iterations |  in  the  table* 

It  is  seen  that  at  any  iteration  up  to  about  the  2000thy  there  has 
been  achieved  in  the  distant^point  case  a  much  greater  absolute  decrease 
in  distance  from  the  equiliboilm  point  than  in  the  nscr-point  case}  though 
roughly  the  same  relative  deorease  in  distance  has  been  achieved*  In 
both  computations  it  is  necessary  at  some  iteration  to  out  the  size  of 
h*  It  is  worth  noting  that  it  is  not  true  that  once  a  variable  attains 
the  value  zerO)  it  stays  at  zero  if  zezo  is  its  value  at  equlllbriim. 

The  variable  in  the  dlstant^point  oomputationy  provides  the  ooxmtei^ 
example* 
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